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Abstract 

We consider asymptotics for the maximum of a modulated random walk whose incre- 
ments are heavy-tailed. Of particular interest is the case where the modulating 
process X is regenerative. Here we study also the maximum of the recursion given 
by W = and, for n > 1, W n = max(0, W n -i + 



1 Introduction 

Let S n = Y2i£i be a sum of i.i.d. random variables (r.v.s) with a negative finite mean 
E£i = —a < 0. The common distribution of the random variables £ n is assumed to be 
right heavy-tailed (i.e. Eexp(A£i) = oo for all A > 0). Moreover, the second tail of this 
distribution is assumed to be subexponential (see Section 2 for definitions). Then the 
classical result (see, e.g., [T2]) states that, as y — > oo, 



1 r°° 

P(sup5 n >y) ~ - / P(& >t)dt. 

n CI Jy 



(1) 



We consider here a more general random walk 

n 

Sn = Y,^ ( 2 ) 

1 

whose increments are modulated by an independent sequence X = {X n } n >i (see 
Section [2] for more precise definitions and notation). We ctSSUIllG t licit Sfi — > — oo a.s. and 
find conditions which are sufficient for the probability of the "rare" event P(sup n S n > y) 
to behave asymptotically (as y — > oo) similarly to ([1]). The results obtained may be applied 
to the study of complex stochastic models with modulated input. 

Particular cases, with X a finite Markov chain, were considered in [2] and pQ. S. Asmussen 
([!]) proposed an approach for getting the asymptotics for P(sup n S n > y) on the basis of 
a regenerative structure: if the maximum of the partial sums over a typical cycle behaves 
asymptotically as the end-to-end sum, and these asymptotics are subexponential, then 
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the result (QQ) stays the same. In [5], the authors assumed that X is countably- valued, a 
certain dependence between the X n and the ^ was allowed, and some homogeneity in x of 
the distributions of the random variables £jj was required. By the use of matrix-analytic 
methods, they found the asymptotics for the stationary distribution of a Markov chain 
with increments £* n . 

In [7], upper and lower bounds were found for the asymptotics of P(R > y), as y — > oo, 
where R is the stationary response time in a tandem queue. Then, in [9], the asymptotics 
for the stationary waiting time W in the second queue were studied. Note that W may be 
represented as the limit of a recursion 



where X = {X n } forms a Harris ergodic Markov chain. In [B], the exact asymptotics for 
P(R > y) were found. The proof is based on ideas similar to that of Lemma [2] of the 
present paper. 

Finally, nice overviews on the current state of large deviations theory in the presence of 
heavy tails were given in [TU] and in recent new books [S] and [3]. 

We state our main results in Section [2j We consider in particular the case where the 
modulating process X is regenerative, where we give also an instructive example and 
counterexample. The latter shows our conditions on the tail of the distribution of the 
regeneration time to be best possible — in a sense made clear there. We study also the 
queueing theory recursion given by W = and, for n > 1, W n = max(0, W n _i + 

In Section |3j we collect together some useful known results, most of which are required for 
our proofs. These are given in Section HJ Perhaps the key result of the entire paper is 
Lemma |2] of that section, which develops an idea found also in [6j. 

2 The main results 

Let (X, B) be a measurable space and X = {X n } n >i an A'-valued discrete-time random 
process. Let P : X x B — » [0, 1] (where £> is the Borel a- algebra on M) be a function such 
that 

(i) for every x G X, P( probability measure; 

(ii) for every B G Bo, P(-,F>) is a measurable function. 

For each x G X, let F x denote the distribution function of P(x, ■). For each integer n > 1, 
introduce the family of real- valued random variables {^} xe ^. Assume that these families 
are mutually independent (in n), do not depend on the process X, and that, for each x G X 
and each n, £^ has distribution function F x . We define the random walk {S n } n >o modulated 
by the process X by S = and, for any n — 1, 2, . . ., 



W n = max(0 > W n _i + e„ n ) 



it 




i=i 
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Define also, for n > 1, 
and let 



M n = max Si, 

0<i<n 



M = sup S n . 

n>0 



Further, for each y > 0, define 

/i(y) = min{n > 1 : S n > y}. 
Note that fi(y) = oo if and only if M < y. 

We are interested the asymptotics of the upper-tail distribution of M under conditions 
which guarantee that the random walk S n behaves sufficiently regularly and has a strictly 
negative drift, and where additionally the distribution functions F x have, in some appro- 
priate sense, heavy positive tails. More precisely, we wish to make statements, under such 
conditions, about the behaviour, for any BeB and as y — > oo, of P(M > y, e B). 

Motivated by queueing theory applications, we are also interested in the behaviour of the 
process {Wn}n>o defined recursively by Wo = and, for n > 1, 

W n = max(0,W n _ 1 + ^"). (3) 

We assume throughout that P is such that each probability measure P(x, ■) (i.e. each 
distribution F x ) has a finite mean. We further assume throughout that there exist a 
distribution function F on IR + with finite mean, and a measurable function c : X — > IR + 
such that 

F x (y) ~ c(x)F(y) as y — > oo, for all x e X, (4) 
sup sup =-^~r = L, for some L < oo. (5) 

Here, for any distribution function H on R, denotes the tail distribution given by 
H(y) = l-H(y). 

The following two conditions on the pair (X, P) will be satisfied in all our results, either 
by hypothesis or as a consequence of more fundamental modelling assumptions. (We 
show below that these conditions may arise naturally in the case where the process X is 
regenerative, but they may also arise in other contexts.) 

(CI) There exists some probability distribution ir on (X, B) such that, for some positive 
integer d, 

P(x n e-) + ... + P(x n+d _ l e-) 



d 

in total variation norm. Here define also 



— > 7r(-), as n — > oo, (6) 



C(B) = / c(x)n(dx), BeB, (7) 
Jb 

and put C = C(X). 
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(C2) The pair (X, P) is such that 

S 

lim — = —a, a.s., for some a > 0. (8) 

n— >oo n 

We need to recall the following definitions. For any distribution function H on R, the 
integrated, or second-tail, distribution H s is given by 

H\y) = min ( 1, / #(t)dt^ . 



A distribution function H on R + is long-tailed if > for all and, for any fixed 

z > 0, _ 

ff(y + *) w1 

— = > 1 as y — > oo. 

A distribution function if on M + is subexponential if H(y) > for all y and 

-= >• 2 as v — > oo. 

^(y) 

(where H* 2 is the convolution of H with itself). It is well known that any subexponential 
distribution is long-tailed. 

We now have Theorems [T] and [2] below. 

Theorem 1. Assume that the conditions (CI) and (C2) hold and that F s is long-tailed. 
Then 

M P(M>rt M eB) > C(B) i JoraUBtB. (9) 

Theorem 2. Assume that the conditions (CI) and (C2) hold, that F s is subexponential, 
and that there exists a distribution function G with negative mean 

/oo 
tdG(t)<0 (10) 
-oo 

such that F x (y) < G(y) for all x and y. Then 

i . mP( M>y,X M eB ) = C(B li forallB€B . 

Remark 1. In an obvious sense, the best candidate for the distribution function G in 
Theorem [2]is the right-continuous version of G(y) = swp x F x (y). 
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As mentioned above, the conditions (CI) and (C2) are frequently satisfied in applications. 
Perhaps the most common instance occurs in the case where X is a regenerative process. 
Here there exists an increasing integer-valued random sequence < To < T% < T2 < . . . 
a.s., such that, if r = T , r n = T n — T n _i, n > 1, then 

Zo = {t~ ; Xi, . . . , X To }, 

Z n = {T n ', X Tn _ 1+ i, . . . , X Tn }, n>l, 

are mutually independent for n > and identically distributed for n > 1. Here r is the 
length of the Oth cycle, r = t\ the length of the first cycle, etc; in particular, if To = 0, 
then the Oth cycle is empty. 

Assume also, for X regenerative as above, that Er is finite. Then the condition (CI) is 
automatically satisfied with 

d = GCD{n : P(r = n) > 0} 
and the probability measure 7r given by 

tt(B) = e ( 53 e B) ] , Be B, (12) 

\i=T +l / 

where I is the indicator function. Suppose also that the modulated random walk S n is 
constructed as above, that 



E{\g\)ir(dx) < 00, (13) 



x 



and that 

/ E^7t(dx) — — a, for some a > 0. (14) 
Jx 

Then, it is an elementary exercise, using the Strong Law of Large Numbers, to show that 
the condition (C2) is satisfied with a as given by f )14p . 

Example 1 . For a particular example of such a random walk modulated by a regenerative 
process, consider a stable tandem queue GI/GI/1 — > GI/1 which is defined by three 
mutually independent sequences {£„}, {cn^} } and {c n 2 ^} of i.i.d. random variables with 
Eix > max{Ecx| 1 ' ) , Eaj 2 ''}. Here the t n are the inter-arrival times at the first queue, while 
the On 1 "* and the are the service times at the first and second queues respectively. Let 
{X n } be the sequence of inter-departure times from the first queue. Then this sequence is 
regenerative (the regeneration indices corresponding to those customers who arrive to find 
the first queue empty), and the distribution of X n converges in the total variation norm to 
a stationary distribution with mean Eii. Consider the sequence £;f n = a n 2 ^ — X n . Under 
natural conditions (see Theorems [3H5] below), we can show that the tail distribution of 
the supremum of a modulated random walk with increments asymptotically coincides 
with that of the stationary waiting time in the second queue. 
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In the case of a regenerative process as above we obtain, in Theorems [3] and H] below, the 
conclusion (ITTj) of Theorem [2] under weaker conditions than that given by (1101) . In each 
case the cost is that of suitable conditions on the distributions of the cycle times To and r. 
Both the theorems are adapted to typical queueing theory applications. 

Theorem 3. Assume that X is regenerative with Er < oo, that the conditions (TT3"j) and 
( I14p hold (with it as given by (fl~2]) ). and that F s is subexponential. Assume also that 

P(br >y) = o(F s (y)), P{br > y) = o(F(y)), as y -> oo, (15) 

for all b > 0. Then the conclusion (fTTT) of Theorem^ again follows. 

Remark 2. As already discussed, the assumptions of Theorem [3] ensure that the earlier 
conditions (CI) and (C2) are satisfied. 

Remark 3 . It will follow from the proof of Theorem [3] that it is enough to assume that the 
condition (fl5i) holds for a certain sufficiently large b. 

Remark 4. The condition ffl~5]) holds for all b > if there exists some A > such that both 
Eexp(Ar) and Eexp(Ar ) are finite. 

Under the conditions of Theorem H] we relax the requirement that the condition (1151) hold 
for all b > 0. This requirement may fail to be satisfied in some examples where the 
conditions of Theorem H] are, however, quite natural — see, e.g., Example [U 

Theorem 4. Assume that X is regenerative with Er < oo, that the conditions (1131) and 
(TT4"|) hold, and that F s is subexponential. Assume also that there exists a family {G x } x£ x 
of distribution functions on M + such that G x (y) is measurable in x for all y, 

F x {y) < G x (y) for all x and for all y, (16) 

and, for each x, G x may be represented as a distribution function of a difference of two 
independent r.v.s 

G x (y) = P(C-b x <y), (17) 
where the distribution of ( does not depend on x, 

P(C > v) 

limsup l _l y) <oo, (18) 
y^oo F(y) 

b x is non-negative a.s., and 

E w b x = J Eb x 7r(dx) > EC- (19) 

Assume further that the condition (fi"5"|) holds for some b > E£. Then the conclusion (FiT]) 
of Theorem^ follows once more. 
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Remark 5. The assumptions on X in Theorem H] again ensure that the earlier condition (CI) 
is satisfied, while it follows from (I16p . (II 7p and ( I19p that the condition (THj) . and so the 
condition (C2), is satisfied. 

Remark 6. It is easy to see that the asymptotics for P(M > y) may be quite different 
from (1111) if the assumption (fTo'j) fails. For instance, assume that the remaining conditions 
of Theorem H]hold with X = 71, F x = G x for all x, ( > 1 a.s., and b x = for all i ^ 0. 
Assume also that X = 0, T = 0, r = t\ = min{n > 0: X n = 0}. The condition (TT9|) here 
becomes E6° > E£Et. Then 

M > max(r! - 1, n - 6° x + r 2 - 1, . . .) = M*. 

If the second tail for P(r > t) is subexponential (and so also long-tailed), then, by ([I]), 

> ^ - r p(t t)dt - 

Finally, again in the case where X is regenerative, we consider the process {W^jn^o defined 
earlier by In the special case where F x = F for all x G X (so that {£„} is an i.i.d. 
sequence), it is well known that the distributions of W n and S n coincide. However, this is 
not generally the case in the present setting. 

Theorem 5. Assume that X is regenerative with Er < oo. Then, under the conditions of 
either Theorem 0, Theorem or Theorem [^J 

1 1 C 

lim =5 limsupP(W / "„ > y) = lim =^ — liminf P(W n > y) — — . (20) 

v-*°° F (y) n-voo y^°° F (y) n ^°° a 

Remark 7. In fact, under the conditions of Theorem [3] or HI the condition on tq (in (TT5]) ) 
is not required for Theorem [5j 



3 Useful Properties 

We recall some known properties of distributions. For any distribution function G on R 
let 

/oo 
tdG(t) 
-oo 

denote its mean. Further, we make the convention that, for distribution functions G and 
H, we write H{y) ~ • G{y) if H{y) = o(G(y)) as y — > oo. 

Property 1. Suppose that distribution functions G and H are such that m(G) is finite, 
m(H) = —h for some h > 0, and H(y) = o(G(y)) as y — > oo. Then, for any e > we 
can find a distribution function H £ such that H(y) < H £ (y) for all y, m(H £ ) < —h/2 and 
H £ {y) = eG{y) for all sufficiently large y. 
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Property 2. Suppose that distribution functions G and H are such that G s exists, and 
that H(y) ~ cG(y) as y — >■ oo for some c > 0. Then H s exists and H (y) ~ cG (y) as 
y — > oo. 

Property 3. Suppose that a distribution function G is such that its second tail distribution 
G s is long-tailed. Then 

G(y) = o(G s (y)) as y oo. (21) 
Further, for any g > and any sequence {«„} such that a n ^r a as n — )■ oo ; 

1 v 

lim =j — > a n G(y + / + ng) = — for all k and for all I. (22) 

Property 4. Suppose that distribution functions G and H are such that H(y) ~ cG(y) 
as y — )■ oo /or some c > 0. T/ien i/ G is subexponential, H is subexponential, while if G s 
subexponential, H s is subexponential and H (y) ~ cG (y) as y —¥ oo. 

Property 5. Let £i, £2, • • • , £n ^ e n mutually independent r.v.s and G a subexponential dis- 
tribution such that, fori = 1,2, ... ,n, P(£j > y) ~ CiG(y) asy — >■ oo, where ci, C2, . . . , c n > 
0. T/ien 

P(6 + 6 + • • • + > 2/) ~ (ci + c 2 + . . . + c n )G(y) as y oo. 

Property 6. Let {£ n } n >i be an i.i.d. sequence of nonnegative random variables with subex- 
ponential distribution G. For any n, put 

• . . ■ • C, ■ //) G* n (y) 

«n = SUp — r = Slip — . ■ 

y >o P(fi > y) y >o G(y) 

Then, for any u > one can choose k > stzc/i i/iai a n < k(l + -u) n for all n. 

Property 7 (Veraverbeke's Theorem). Let {£„} n >i be an i.i.d. sequence of random vari- 
ables with distribution function G and a negative mean —g = E£i < 0. Suppose that the 
second-tail distribution G s is subexponential. Set S' n = Y^i=i&> an< ^ M' = max(0, sup n S' n ). 
Then, as y — )■ oo, 



P(M' > y) ~ P ( |J > V + ng} ) ~ £ P(£ n > y + no) ~ -G s (y). 

\n>l / n>l ^ 



(23) 



Thus, under the conditions of Veraverbeke's Theorem, the supremum M' is large if and 
only if one of summands is large. The following three properties are all corollaries of 
Veraverbeke's Theorem. In particular Property [9] follows easily on using also Property [T] 
above. 
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Property 8. Under the conditions of Veraverbeke's Theorem above, for any g G {0,g), 

oo 

J2 P (K <y,S'n£ (-ng,y},S' n+1 > y) = o{G\y)) as y -> oo, 

n=l 

where, for each n, M' n = max(0, maxi<j< n S^) . 

Property 9. Let {£ n } n >i be an i.i.d. sequence of random variables with distribution func- 
tion H and negative mean E£i < 0. Suppose that H(y) = o{G{y)), as y —¥ oo, for some dis- 
tribution function G whose second-tail distribution G s is subexponential. Set S' n = Y17=i & 
and M' = max(0, sup n S' n ) . Then 

P(M' > y) = o(G s (y)) as y -» oo. 

Property 10. Let {^ n }n>i be an i.i.d. sequence of random variables with distribution 
function H and negative mean E£i < 0. Suppose that H(y) ~ c{G {%/)), as y — >■ co ; 
for some c > and some distribution function G whose second-tail distribution G s is 
subexponential. Let r' be an independent positive integer-valued random variable. Then 

P max VVj > y) = o(G 8 (y)) as y oo. 

\ l<n<r ^—^ ' / 
\ i=l / 

4 Proofs 

Proof of Theorem [IJ We prove the theorem in the case where the constant d of the condi- 
tion (CI) is equal to 1. The modification required for the general case is quite obvious. By 
the Strong Law of Large Numbers, for any e G (0, a), we can choose R = R{e) such that 

P {S n G [-R -n{a + e),R- n(a - e)\ for all n = 0, 1, 2, . . .) > 1 - e. 

Put 

D n = {Si G [-R — i(a + e), R — i(a — e)] for all z = 0, 1, 2, ... , n} 
and D = D^. Since C D n for all n, P(D n ) > 1 — e. 
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Now, for all sufficiently large y > 0, 
P(M>y,X Ky) eB) 

oo 

= p ( M n < y, S n+ i > y, x n+l e B) 



n=0 

oo 



> J2 p ( D n,S n+ i >y,x n+l G B) 

n=0 

oo „ 

>J2 P(D n ,X n+1 edx)F x (y + R + n(a + e)) 

n=0 ^ B 

00 r r 

>J2 P(X n+1 G dx)F x (y + R + n(a + e)) - P{D)LF(y + R + n(a + e)) 



n=0 
00 r 



/ vr(rfx)F :E (|/ + J R + n(a + £)) - (P(D) + 5 n+1 ) + + 

n=0 L-'B 



n(a + e)) 



where, for each n, 5 n = sup B \P(X n G B) —ir(B) \ is the distance in total variation between 
the distributions of X n and 7r. The condition (CI) implies that 8 n — > as n — > 00. Since 
F s is long-tailed, it now follows from (J3J), §5§ and ( li2"2"j) that, for all 2, 



_^ 00 

lim =_ VF s (3/ + i* + n(a + e)) 

«^°° F (y) ^ 



c(x) 
a + e 



and that 



lim sup 



! OO ^ OO 

EF^y + i2 + n(a + £)) < lim =- s — ~F(y + R + n(a + e)) 



00 F (v) ^ 



i 71 (y) ^ 

L 

a + e 



(24) 



(where the convergence to the limit above is of course independent of x). Hence, by the 
Bounded Convergence Theorem, 



F (y) ^ =() 

Also, again from (122 



1 °° /" 



+ n(a + e)) 



C{B) 



a + e 



(25) 



j 00 

lim V 5 n+1 F(y + R + n(a + e)) = 0. 

F (2/) ^ 



Thus, again using 



hminf =^P(M > y, X^j G B) > " LP(D) 



Now let £ — >• to obtain the required result. 



a + e 



□ 
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We now give two lemmas which are required for the remaining results. 
Lemma 1. Suppose that the conditions of Theorem^ hold and that 



y^oo F (y) 

Then the conclusion (TTTj) follows. 

Proof. From (126]) . for any B G X, 

C P(M>y) 
— > hm sup — — 



P(M>y) C , . 

limsup^s —<—■ (26) 



F (y) 

P(M > y, X Ky) G B) P(M > y, G B) 



lim sup 

y— >oo 



F(y) F\y) 



P(M>y,X^ y) EB) P(M>y,X, {y) eB) 
> hm sup =5 — h hm mi 



y^oo F (y) v->°° F (y) 

P(M>y,X Kv) eB) C(B) 
> hm sup =g — 1 , 

y^oo F (y) a 

where the last inequality follows by Theorem [TJ Since C = C(B) + C(B), the conclusion 
(ITTj) follows as required. □ 

In each of the proofs of Theorems [2J [3] and H] we show that, for all e satisfying < e < a, 
there exists R > (depending on e) such that, if, for each n — 1, 2, . . ., 

D' n = {Sj < R — j(a — e) for all j — 1, . . . , n — 1; S n+ i — S n < R for alH = 1, 2, . . .}, 

(27) 

then P(D' n ) > 1 — e for all n. In each case we then require Lemma [2] below to complete 
the proof. 

Lemma 2. Suppose that F s is subexponential, that there exist a sequence of i.i.d. random 
variables {ip n }n>i and a constant L\ such that ~Eipi < and 

P(A >y)< L.Fiy) (28) 

for all y > 0, and that ip n is independent of D' n for all n > 1. Suppose further that the 
condition (CI) is satisfied and that 

P(M > y) <P(M > y,M^ > y) + o(F s (y)) as y oo, (29) 

where = max(0, sup n Y^i=i rfi) ■ Then the conclusion ( TTTj) follows. 
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Proof. As in the proof of Theorem dj we assume that the constant d of the condition (CI) 
is equal to 1. We may further assume, without loss of generality, that the condition ( I2"gj) 
is satisfied with equality for all sufficiently large y. (If this is not the case we can use 
Property [1] of Section [3] to replace {ip n }n>i with i.i.d. sequence {ip n }n>i satisfying all the 
conditions of the lemma and with also the required equality in (1281) .) It follows that the 
common distribution of the random variables if) n has a second-tail distribution which is 
subexponential. Thus, if g = — E(V'i) ( so 9 > 0), it follows from the conditions of the 
lemma and Veraverbeke's Theorem that 

P(M > y) < P(M > y, > y) + o(F\y)) 

oo 

= P ( M >V,i>n>y + ng) + o(F s (y)) 

71=1 

< S 1 + E 2 + (F(y)), (30) 

where 

oo oo 

Si = ^ P ( D n, Af > y), Z 2 = J2 M > y,ip n > y + ng). 

n=l n=l 

Since, for each n, ^ is independent of D' n , we have, using (f22i) . 

E 2 <VP(^)P(i>2/ + ng)<(l + o(l))-?(|/) asy^oo. (31) 

We now consider Si. Take y > R. For any n, the event 

V n = D' n n < 2/ - 2i? + (n - l)(a - e)} C {M < y}. (32) 
To see this, note that, on the set V n , Sj < R — j(a — e) for all j < n, 

S n = S^-i +£ n <y-R 

and, for % = 1, 2, . . ., 

^n+i = S n + (S n+i -S n )<y-R + R = y. 

Thus, from (1321 . 
Si < J] P(£n " > 2/ " 2i2 + (n - l)(a - e)) 

n 

= V/ P(X n ette)F a> (y-2i2+(n-l)(a-e)) 

n ^ 

< V / i(dx)F,(t/ - 2fi + (n - l)(a - e)) + L V i - 2fi + (n - l)(a - e)), 
„ J x 



12 



where, as in the the proof of Theorem [Tj, 8 n is the distance in total variation between the 
distributions of X n and n, and so tends to as n — > oo. Exactly as in that proof, it now 
follows from fl22|l and the Bounded Convergence Theorem that 

lim sup ==g < . 

y->oo F (y) a- e 

It now follows, on recalling ( 130]) and (1311) and letting e — > 0, that the condition (126]) of 
Lemma [TJ is satisfied. The required conclusion (11 ip now follows from that lemma. □ 

Proof of Theorem^ It follows from the condition (j5]) that, without loss of generality, we 
can assume that G(y) < LF(y) for all y. Let {a n } n >i be an i.i.d. sequence of random 
variables uniformly distributed on (0, 1) and independent of X = {X n }. Construct the 
required family of random variables {^} n >i by defining, for each n, = F~ 1 (a n )] for 
each n define also ip n = G~ l {a n ). Here, for any distribution function H, the quantile 
function if -1 is given by 

H-\t) = sup{z : H(z) < t}. 

Note that the pairs ip n ), n > 1, are independent in n, that the sequence {ip n }n>i is 
i.i.d. with E^i < (from ffTU]) ) and distribution function G, and that 

£<ip n a.s.. (33) 

s* = EU ^ and 

= max(0,sup^). 

n 

From the SLLN for {?/> n } and from the condition (C2), for any e > 0, there exists R > 
such that, for any n = 1, 2, . . ., 

P(Sj<R-j(a-e), .7 = 1,2,. ..,n-l; S^ + j — S$ < R, i = 1, 2, . . .) > 1 - e. 

Hence, from (1331) . P(-D'J > 1 — e for all n, where each D' n is as given by (1271) . Also from 

m. 

P(M > y) = P(M >y,M^ > y). 

It is now easy to check that all the conditions of Lemma [2] are satisfied, with each ^ n and 
D' n as given here, and the required result now follows from that lemma. □ 

The following further two lemmas are also required in each of the proofs of Theorems |3] 
andH] (where in each case X is regenerative). 

Lemma 3. Suppose that X is regenerative with Er < oo and also that F s is subexponential. 
Let {{f]^} x &x}n>i be a sequence of families of random variables such that these families 
are independent and identically distributed in n and are further independent of X . Suppose 
further that there exists a constant b > satisfying the condition (I15p and such that 

7]l < b a.s. for all x, (34) 
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and that 



Define 



Then 



Proof. Define 



Erjf 7i(dx) < 0. (35) 



x 



M v = max ( 0, sup ^ rjf* j . 

V n i=i J 

P(M" >y) = o(F s (y)) as y ^ oo. 



f 3 n= ^> n>l. 

i=T n -!+l 

Observe that {(3 n }n>i is an i.i.d. sequence with, from (|34|) and ( )35|) . 

Eft < 0, n < br n) n>\. 

Since also X is regenerative with E(r) < oo, we can choose K > sufficiently large that if 

7„ = max(/3 n , br n — K), n> 1, (36) 
then {7„}„>i is an i.i.d. sequence with 

E 7l <0, 7n<br n , n>l. (37) 

Define also 

/ 

M 7 = max 0, sup \. 7? 

It follows from f )37|) . the assumed condition f lT5|) (for b as given) and the extension of 
Veraverbeke's Theorem given by Property [9] of Section [31 that 

P(M 7 >y) = o(F s (y)), as y oo. (38) 

Now 

M* 7 < 6r + sup(6ri, ft + 6r 2 , ft + /3 2 + &r 3 , . . .) 

< br + K + sup(7i, 7i + 72, 71 + 72 + 73, • • •) 

< br + K + M\ 

where the second inequality above follows from (|36|) . Further r and M 7 are independent. 
The required result now follows from (1351) . the assumed condition (|T5"1) and Property E] of 
Section [3J □ 
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The following lemma combines the results of Lemmas [2] and [3] to provide a set of conditions 
for the regenerative case under which there follows the desired conclusion ( 1111) of both 
Theorems [3] and HI 

Lemma 4. Suppose that X is regenerative with Er < oo and also that F s is subexpo- 
nential. Suppose also that there exist a sequence of i.i.d. random variables {ip n } n >i and a 
constant L i satisfying the conditions of Lemma^ i.e. that 

E(Vi)<0, P& 1 >y)<L 1 F(y) for ally >0, (39) 

and that 

ip n is independent of D' n for all n > 1 (40) 

(where D' n is as given by fl27|) ). Suppose further that there exists a sequence of families 
of random variables {{r)n}xex}n>i an d a constant b > satisfying all the conditions of 
Lemma\^ and that 

&<ipn + ril n>l. (41) 

Again define 

= max ^0, sup ipi \ , M v = max ^0, sup ^ V** \ ■ 

Finally, suppose that and M v are independent. Then the conclusion (JTTJ) follows. 

Proof. As in the proof of Lemma [2] we may assume, without loss of generality, that 
P{ipi > y) = LxF(y) for all sufficiently large y. It then follows from the conditions 
on the sequence {ijj n } and Veraverbeke's Theorem that 

P(M^>y)r^L 1 F s (y), as y -> oo, (42) 
while it follows from Lemma [3] that 

P(M" > y) = o(F s (y)), as y -»■ oo. (43) 

From the condition (|41[) we have that 

M <M^ + M v . (44) 

Since also and M v are independent, it now follows from f )42|) . fj4^|) . (jHJ) and Property |5] 
of Section [3] that 

P(M > y) = P(M > y,M^ > y) + o(F s (y)) as y oo. (45) 

Finally, since X is regenerative, the condition (CI), and so now all the conditions of 
Lemma El are satisfied and so the required conclusion ( ITTj) again follows from that lemma. 

□ 
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Proof of Theorem^ We construct the sequences {ip n } n >i and {{Vn}xex}n>i an d the con- 
stants Li and b such that all the conditions of Lemma S] are satisfied. 
It follows from 03) that we can find a distribution function GonM such that 

F x (y)<G(y)<LF(y), (46) 

for all y and for all x G X. As in the proof of Theorem [2J, let {a n } n >i be an i.i.d. 
sequence of random variables uniformly distributed on (0, 1) and independent of X = {X n }. 
Again construct the required family of random variables {£n}n>i by defining, for each n, 
= F~ 1 (a n ); for each n define also ( n = G~ 1 (a n ). Then the pairs (£^,Cn), n > 1, are 
independent in n, the sequence {( n }n>i is i.i.d., and 

£f™ < Cn a.s., for all n. (47) 

For y > 0, define 

u(y ) = E[I(d > y )Ci], v(y ) = - [ E[I(G < y )8Mdx). 

Observe that u(yo) — > as yo — >■ oo and, by the conditions (|T3|) and ( IT4|) . t>(?/o) — a as 
yo oo. Choose y sufficiently large and K > such that 

ufeo) < P(Ci > Vo)K < v{y ). (48) 

We define the required i.i.d. sequence {ip n }n>i by 

1p n = l(( n > y )(( n - K). 

It follows from the construction of this sequence, and in particular from ( T46]) . (T48]) and the 
definition of u(yo), that it satisfies the conditions ( 139)) and ( 140]) of Lemma H] with L x = L. 
Define also, for each n and for each x, 

^ = I(Cn<2/b)£ + I(Cn>3/o)tf, 

The random variables r/^ are bounded above by b = max(y , ^0- Further, by (l4"8"j) and the 
definition of v(y ), 

/ E^'vr(c/x) < 0. 

It now follows, using also the condition (TT5]) of the theorem, that the sequence {{f]n}xex}n>i 
and 6 as given above satisfy the conditions of Lemma [3j and so also of Lemma HI 
The condition (14TI) follows on observing that, from (f47|) . for all x and for all rz, 

C = I(Cn > </o)(£* - AT) + I(C» < Vo)C + I(Cn > 0b)# 

Finally, it is not difficult to see that the random variables and M v (defined as in the 
statement of Lemma Hj) are independent (although the sequences {ip n } and {T)n n } °f which 
they are the maxima are not independent!). The required conclusion (fTTT) now follows from 
Lemma HI □ 
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Proof of Theorem^ We again use Lemma HI It follows from the conditions of the theorem 
that we may take b such that 

EC < b < E T b x (49) 
and satisfying ( I15p . It follows also from fll8p that there exists L\ > such that 

P(C > y) < Li~F(y) (50) 

for all y. Further, we may define random variables {(, x } x ex, (, and {b x } x£ x in such a way 
that ( and the family {b x } x< zx are independent and, for all x, 

r < C - b x a.s.. (51) 

For n — 1, 2, . . ., let 6^, £„} be i.i.d. copies of {^ a: , b x , (}, such that these sequences are 
jointly independent of the process X. Define, for all n, 

lpn=Cn~b, T] X = b-b X , XE X. (52) 

Then it is easy to check, from (14^]) - (1B^|) and the condition f)15p and the independence 
assumption of the theorem, that all the conditions of Lemma H] are satisfied. The se- 
quences {ip n }n>i and {{f]n}xex}n>i and the constants L\ and b of that lemma are as given 
here. We thus have the required result. □ 

Proof of Theorem^ We again give the proof in the case d — 1. It follows straightforwardly 
from the regenerative structure of X, the condition Er < oo, and the condition (C2) that 
the random vectors 

Y = {t -W 1 ,...,W To }, 

Y n = {r n ,W Tn _ 1+1 ,...,W Tn }, n> 1, 

form a Harris ergodic Markov chain (see, for example, [H]). Then, since d — 1, it is 
again straightforward that W n converges in the total variation norm to a distribution on 
R + which is independent of that of Y . Now let X = {X„}_ 00<n<00 be the corresponding 
stationary version of the process X indexed over the entire set of integers, and similarly 
extend the i.i.d. sequence of families {{H}x&x}n>i to {{Cn}xex}~oo<n<oo- Let {IKjn^o 
(with Wo = as usual) be the corresponding version of the process {W n } n >o. It follows 
from the recursion ([3]) that 

W n = max (0, + ^\ . . . , & + ■ ■ ■ + tf 1 ) 

which, by stationarity, has the same distribution as 

max (o, cV.c V: + d~ 2 , . . • , dr 1 + • ■ ■ + dn n ) ■ 

Thus, for any y, lim^oo P(iy„ > y) and lim n _^ 00 P(W n > y) both exist and are equal to 
P(M~ > y) where 

m- = su P (o,d-\dr+d~v--)- 
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The required result now follows from the application of Theorem [2J [3] or H] as appropriate, 
in each case with B = X, to the time-reversed version of the stationary process {X n , 
However, under the conditions of Theorem [3] or Theorem HI we must also verify the required 
condition on Tq, defined to be the time of the first regeneration at or after time in the 
reversed process X~ = {X~} n > given by X~ = X_ n . Standard renewal theory shows 
that the distribution of Tq is given by 

j oo 

P{T ° - n) = EOT) S P ( r ^)> n = 0,l,... 

\ ' k=n+l 

An easy calculation, analogous to that of the derivation of Property[2]of Section[3l now gives 
that, if b > is such that P(6r > y) = o(F(y)) as y — > oo, then P(&r " > y) = o(F (y)) 
as y — > oo. Thus, in each case, the required condition on Tq follows from the assumed 
condition on r. 

The modifications for the case of general d are again routine. □ 
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